United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


10/693,231 


10/23/2003 


Tomokazu Kake 


81659 [SC-70004US] 


1421 



22242 7590 02/02/2009 

FITCH EVEN TABIN AND FLANNERY 
120 SOUTH LASALLE STREET 
SUITE 1600 

CHICAGO, IL 60603-3406 



EXAMINER 



BROOME, SAID A 



PAPER NUMBER 



2628 



MAIL DATE 



DELIVERY MODE 



02/02/2009 PAPER 

Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



\JI 1 1 Ot? n\* If SJtl OUffffffCff y 


Application No. 

10/693,231 


Applicant(s) 

KAKE ET AL. 


Examiner 

SAID BROOME 


Art Unit 

2628 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )^l Responsive to communication(s) filed on 13 November 2008 . 
2a )□ This action is FINAL. 2b)^ This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-14,17,22 and 24-41 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) |EI Claim(s) 4-14.27.29.31.33.35 and 40 is/are allowed. 

6) |EI Claim(s) 1-3. 1 7. 22. 24-26. 28. 32. 34. 36-39 and 4 1 is/are rejected. 

7) [3 Claim(s) 30 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) n The drawing(s) filed on is/are: a)\Z\ accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)Q All b)Q Some * c)Q None of: 

1 0 Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1 ) □ Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) O Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 



4) O Interview Summary (PTO-41 3) 

Paper No(s)/Mail Date. . 

5) Q Notice of Informal Patent Application 

6) □ Other: . 



U.S. Patent and Trademark Office 

PTOL-326 (Rev. 08-06) 



Office Action Summary 



Part of Paper No./Mail Date 20090124 



Application/Control Number: 10/693,231 Page 2 

Art Unit: 2628 

DETAILED ACTION 

Response to Amendment 

1 . This office action is in response to an amendment filed on 1 1/13/2008. 

2. Claims 17, 22, 24 and 41 have been amended by the applicant. 

3. Claims 1-14 and 25-40 are original. 

4. Claims 15, 16, 18-21, 23 and 42 have been cancelled. 

Allowable Subject Matter 

The indicated allowability of claims 1-3 are withdrawn in view of the rejection under 35 
U.S.C. 101, as described in the office action below. 

In regards to claim 30, Seki and Fels do not teach that the attribute value is a value that 
indicates the order of approximation relative to a desired image pattern, therefore claim 30 is 
objected to as being dependent upon a rejected base claim, but would be allowable if rewritten in 
independent form including all of the limitations of the base claim and any intervening claims. 

Claims 4-14, 27, 29, 31, 33, 35 and 40 are allowed. The following is an examiner's 
statement of reasons for allowance: 

The prior art, Seki (JP 09-035040), does not teach the limitations of claim 4. In regards to 
claim 4, Seki describes original moving pictures as two-dimensional images that vary along time 
axis, and when the moving pictures are expressed, in a virtual manner, as a box space formed by 
the two-dimensional images and the time axis, cutting the box space by a surface that contains a 
plurality of points each of which differs from the other in time value (TJ001 1 lines 5-9: ". ..there 
is a time axis (T-axis) perpendicular to both X-axis and Y-axis, by setting the images along this 
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axis, it is possible to construct the three-dimensional image shown in Fig. 3, that is, time-space 
image I(x, y; t). In step SP2, said time-space image I(x, y; t) is cut by a plane parallel to the time 
axis, and the image appearing on the cut plane is taken as cross-sectional image. . .", Fig. 3) and 
varying the cut surface in time (T[00 1 0 lines 4-5 : "...the cross-section of the time-space image 
taken by a plane parallel to the time axis"). However, none of the prior art teaches or suggests 
projecting a first image that appears on the cut surface onto a first plane perpendicular to the time 
axis, projecting a second image that appears on the varied cut surface onto a second plane 
perpendicular to the time axis, and outputting the first and second images appearing on the first 
and second planes as new moving pictures, therefore claims 4-14, 27, 29, 31, 33 and 35 are 
allowable. 

The prior art, Seki (JP 09-035040), does not teach the limitations of claim 40. In regards 
to claim 40, Seki teaches original moving pictures as two-dimensional images that vary along 
time axis, and when the moving pictures are expressed, in a virtual manner, as a box space 
formed by the two-dimensional images and the time axis, cutting the box space by a surface that 
contains a plurality of points each of which differs from the other in time value (TJ001 1 lines 5-9: 
". ..there is a time axis (T-axis) perpendicular to both X-axis and Y-axis, by setting the images 
along this axis, it is possible to construct the three-dimensional image shown in Fig. 3, that is, 
time-space image I(x, y; t). In step SP2, said time-space image I(x, y; t) is cut by a plane parallel 
to the time axis, and the image appearing on the cut plane is taken as cross-sectional image. . .", 
Fig. 3) and varying the cut surface in time fl[0010 lines 4-5: ". . .the cross-section of the 
time-space image taken by a plane parallel to the time axis"). However, none of the prior art 
teaches or suggests projecting a first image that appears on the cut surface onto a first plane 
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perpendicular to the time axis, projecting a second image that appears on the varied cut surface 
onto a second plane perpendicular to the time axis, and outputting the first and second images 
appearing on the first and second planes as new moving pictures, therefore claim 40 is allowable. 

Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or 
any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and 
requirements of this title. 

Claims 1-3 are rejected under 35 U.S.C. 101 as not falling within one of the four statutory 
categories of invention. While the claims recite a series of steps or acts to be performed, a 
statutory "process" under 35 U.S.C. 101 must (1) be tied to another statutory category (such as a 
particular apparatus), or (2) transform underlying subject matter (such as an article or material) 
to a different state or thing. The instant claims neither transform underlying subject matter nor 
positively tie to another statutory category that accomplishes the claimed method steps, and 
therefore do not qualify as a statutory process. For instance, claim 1 recites steps such as 
"expressing pictures that vary along a time axis as a box space", however the method steps of 
claim 1 do not require a particular computer or apparatus with which to implement the steps. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 
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Claims 17, 22, 24-26, 28, 32, 34 and 36 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Seki (JP 09-035040). 

Regarding claim 17, Seki describes an image generating method (1(0001 lines 2-3: 
". ..invention pertains to an image processing method. . ."), including: 

reading out, for a first in-picture position of a first image contained in a first target frame 
in original moving pictures, first data that correspond to the in-picture position (1(00 12 lines 1-2 
and 6-1 1 : "...a portion of the image of moving object (21) contained in the original consecutive 
images must appear as the trace. . . This is called trace cross-sectional image L(s, 9; t), and it is 
found that this image becomes a place containing the velocity vector of the moving object. . . This 
plane completely contains the information pertaining to the movement of the object. . .", where a 
certain region from all the frames is captured, Fig. 4); 

synthesizing the first data in a ratio according to an attribute value of the first image 
(TJ0012 lines 1-2 and 8-11: "On said cross-sectional image C(d, t; 0), a portion of the image of 
moving object (21) contained in the original consecutive images must appear as the trace... this 
trace cross-sectional image L(s, 0; t) is an image obtained by cutting said time-space image I(x, 
y; t) with a helix plane along the movement direction of the object. This plane completely 
contains the information pertaining to the movement of the object. . .", where an attribute value, 
such as the proportional difference in the position of the object over time, is tracked and 
presented in a synthesized image that displays the movement of the object over a time interval, 
Fig. 5); 

reading out, for a second in-picture position of a second image contained in a second 
target frame in the original moving pictures, data that correspond to the second in-picture 
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position (TjOOl 1 lines 8-1 1 : ". . .the image appearing on the cut plane is taken as cross-sectional 
image C. . .plural cross-sectional images C(d, t; 0) can be obtained. . . ", in which several 
projected cross sectional images containing in-picture positions, Fig. 5, may be obtained and 
appear on the cut surface); 

synthesizing the second read-out data in a ratio according to an attribute value of the 
second image (TJ001 1 lines 8-11: ". ..the image appearing on the cut plane is taken as 
cross-sectional image C. . .plural cross-sectional images ...can be obtained. . . " and ](0012 lines 
1-2 and 8-11: "(9/? said cross-sectional image C(d, t; 6), a portion of the image of moving object 
(21) contained in the original consecutive images must appear as the trace. ..this trace 
cross-sectional image L(s, 6; t) is an image obtained by cutting said time-space image I(x, y; t) 
with a helix plane along the movement direction of the object. This plane completely contains the 
information pertaining to the movement of the object. . .", where an attribute value, such as the 
proportional difference in the position of the object over time, is tracked and presented in a 
synthesized image that displays the movement of the object as imaged in second, or subsequent 
consecutively captured images over a time interval, Fig. 5); and 

forming new moving images by sequentially outputting at least the first and second 
frames formed in the synthesizing along a time axis (Tj0015 lines 1-5: "When there are plural 
moving objects in the cross-sectional images, plural groups of the cross-sectional images are 
prepared corresponding to the respective objects, to get the trace cross-sectional image for each 
object." and ](0012 lines 1-2 and 8-11: "On said cross-sectional image C(d, t; 9), a portion of the 
image of moving object (21) contained in the original consecutive images must appear as the 
trace... this trace cross-sectional image... is an image obtained by cutting said time-space image 
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I(x, y; t)...This plane completely contains the information pertaining to the movement of the 
object. . ." and is illustrated in Fig. 3: axis T, in which output of several synthesized images is 
provided to enable a user to animate the movement of several objects in a sequence of images 
across the time axis T through generation of several synthesized images for each group that 
corresponds to an object in sequence of images, whereby a special effect may then be visualized 
showing the movement of several objects present in the sequence of images). 

Regarding claims 22 and 24, Seki describes an image generating apparatus which 
includes an image memory, an image conversion unit and an image data output unit (TjOOl 1 lines 
1-3: ". ..a camcorder is used to take the consecutive images that are input to an image 
processor... as shown in Figure I, as the images. ..are represented. . .", in which an image pickup 
apparatus enables captured images, thereby stored on memory within the apparatus, to enable 
image display conversion processing enabling the images to be output, as recited in claims 22 
and 24), and a computer readable medium encoded with a computer program (TJ001 1 lines 1-3: 
". . .a camcorder is used to take the consecutive images that are input to an image processor... as 
shown in Figure 1, as the images... are represented...''', Fig. 4, stores a program to execute the 
image generation, Fig. 4, as recited in the preamble of claim 41), 

wherein said image memory (1(001 1 lines 1-2: "As shown in Fig. I, for example, a 
camcorder is used to take the consecutive images that are input to an image processor", in 
which the images are collected by an image pickup device and are thereby stored in an image 
memory, as disclosed in claims 22 and 24), records, in sequence, original moving pictures for 
each frame, wherein said image conversion unit determines, for each in-picture position of an 
image contained in a target frame (1(0012 lines 1-2 and 8-11: "On said cross-sectional image 
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C(d, t; 9), a portion of the image of moving object (21) contained in the original consecutive 
images must appear as the trace. ..this trace cross-sectional image L(s, 9; t) is an image 
obtained by cutting said time-space image I(x, y; t) with a helix plane along the movement 
direction of the object. This plane completely contains the information pertaining to the 
movement of the object. . .", wherein for the successive frames, the position of an object in image 
is tracked, Fig. 4), a plurality of frames at predetermined time intervals from the frames recorded 
in said image memory (^[00 13 lines 1-2: " . . .all of the consecutive images within a prescribed 
time are obtained beforehand.' 1 , where fames are captured over a predetermined time interval, 
that enables the time intervals between the frames to be predetermined, Fig. 2), 

wherein said image conversion unit reads out, from the plurality of frames, data that 
correspond to the in-picture position and synthesizes the data in a ratio according to an attribute 
value (]f0012 lines 1-2 and 6-11: "...a portion of the image of moving object (21) contained in the 
original consecutive images must appear as the trace. . . This is called trace cross-sectional image 
L(s, 9; t), and it is found that this image becomes a place containing the velocity vector of the 
moving object. . . This plane completely contains the information pertaining to the movement of 
the object. . .", where a certain region from all the frames is captured, as shown in Fig. 4, where 
an attribute value, such as the proportional difference in the position of the object over time, is 
tracked and presented in a synthesized image that displays the movement of the object over a 
time interval, Fig. 5), and 

wherein said image data output unit sequentially outputs the synthesized and 
reconstructed image data along a time axis fl[0015 lines 1-5: 'When there are plural moving 
objects in the cross-sectional images, plural groups of the cross-sectional images are prepared 
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corresponding to the respective objects, to get the trace cross-sectional image for each object." 
and TJ0012 lines 1-2 and 8-11: "On said cross-sectional image C(d, t; 0), a portion of the image 
of moving object (21) contained in the original consecutive images must appear as. ..an image 
obtained by cutting said time-space image I(x, y; t) ...This plane completely contains the 
information pertaining to the movement of the object. . ." and is illustrated in Fig. 3: axis T, in 
which output of several synthesized images is provided to enable a user to animate the movement 
of several objects in a sequence of images across the time axis T through generation of several 
synthesized images for each group that corresponds to an object in sequence of images, whereby 
a special effect may then be visualized showing the movement of several objects present in the 
sequence of images). 

Regarding claim 25, Seki describes that the target frame or at least one of frames is at 
least one of a previous frame in time or a subsequent frame in time with respect to a reference 
frame which should have been naturally outputted by said image data output unit from said 
image memory (]|0006 lines 6-7: ". . .all of the consecutive images over a prescribed time are set 
side-by-side in time to form a three-dimensional time-space image. . .", where the frames are 
successively located along a time axis, enabling a particular frame that is presently analyzed to 
have a frame from the past in reference to a current frame). 

Regarding claim 26, Seki describes that for each in-picture position of the images 
contained in the target frame, the image conversion unit or processor adds a predetermined pixel 
value in accordance with an attribute value thereof fl[0016 lines 3-7: ". . .cutting of the initial 
time-space image is performed in all directions. ..the cutting plane is made of a helix plane along 
the movement trace of the object, and this plane completely contains the movement vector of the 



Application/Control Number: 10/693,231 Page 10 

Art Unit: 2628 

object, and it contains all of the information about the movement trace", where a predetermined 
cut is performed on the surface containing a position, or pixel value, within the frames to track 
the movement of the object in accordance with an attribute value, such as the specified time 
interval of the frames, TJ001 1 lines 1-5: ". ..a camcorder is used to take the consecutive 
images., .as the images at an instant (11, 12, 13) shown in Fig. 2 are represented as I(x, y) with 
the orthogonal coordinates of X-axis and Y-axis, all of the images obtained are set side-by-side 
in time sequence"). 

Regarding claim 28, Seki describes an attribute value is a depth value (TJ001 1 lines 5-7: 
". ..there is a time axis (T-axis) perpendicular to both X-axis and Y-axis, by setting the images 
along this axis, it is possible to construct the three-dimensional image shown in Fig. 3, that is, 
time-space image I(x, y; t).", Fig. 3). 

Regarding claim 32, Seki describes an attribute value is a value that indicates a degree of 
change of an image area in time (TJ0016 lines 3-7: ". . .cutting of the initial time-space image is 
performed in all directions .. .the cutting plane is made of a helix plane along the movement trace 
of the object, and this plane completely contains the movement vector of the object, and it 
contains all of the information about the movement trace"). 

Regarding claim 34, Seki describes the attribute value is a pixel value (TJ0012 lines 1-2: 
"...a portion of the image of moving object (21) contained in the original consecutive images 
must appear as the trace... only the portion containing angle Qa is extracted from each 
cross-sectional image C(d, t; 9), and a new image is formed", where the position of the pixel 
with the image frame is tracked over a time interval). 
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Regarding claim 36, Seki describes acquiring, as moving pictures, images shot by a 
camera and sending image to image memory fl[001 1 lines 1-2: ". . .a camcorder is used to take 
the consecutive images that are input to an image processor.''', where the teachings of Seki 
provide an image input unit which acquires, as the original moving pictures, image shot by a 
camera and sends the images to a camcorder, thereby containing an internal image memory). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 37-39 are rejected under 35 U.S.C. 103(a) as being unpatentable over Seki in 
view of Fels et al. (hereinafter "Fels", "Techniques for Interactive Video Cubism"). 

Regarding claim 37, Seki fails to teach a setting input unit which acquires, via a user 
operation, input of a setting value used to determine the at least one of frames, wherein said 
image conversion unit determines the at least one of frames according to the setting value 
acquired by said setting input unit. Fels teaches a setting input unit and image conversion unit 
(sec. 1 1 st Tf lines 1-3: "Using the mouse as a virtual trackball, the user is able to rotate or 
translate the entire scene, the video cube, or the cut plane", where a plane which corresponds 
with an associated frame, as shown in Fig. I, may be selected by user input, thereby enabling 
one skilled in the art to understand that the input capabilities provided to the user has a 
functionally equivalent setting input unit, as well as an image conversion unit to process the 
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displayed images, which acquires, via user operation, input of a setting value used to determine 
the at least one of frames, as disclosed in sec. 1 1 st Tf lines 1-3: "Using the mouse as a virtual 
trackball, the user is able to rotate or translate the entire scene, the video cube, or the cut 
plane"), where the image conversion unit cuts the box space by the surface defined by a function 
of the setting value acquired by the setting input unit (sec. 3.3.1 lines 1-2: "The cut plane allows 
the user to move a planar window inside the video cube and examine the corresponding 
imagery. ..", where the three-dimensional surface is cut by a plane, Fig. 3, in which the 
teachings of Seki provide processed images that are therefore displayed and obtained using a 
functionally equivalent image conversion), therefore it would have been obvious to one of 
ordinary skill in the art to modify the captured frames generated by Seki with the interactive 
frame interaction provided by Fels because this modification would provide the ability to 
accurately display successive frames of animation or video collectively in a three-dimensional 
format in which the user may interactive with the data to define a plane by which to cut the 
surface of the data to define a representation of the change of the images or frames over a time 
interval thereby enabling temporal analysis of the data. 

Regarding claim 38, Seki describes a curve that indicates a relation between coordinates 
of points contained in the two-dimensional images and time values thereof and a variable of the 
function is displayed on a screen (]|0012 lines 1-11: "On said cross-sectional image C(d, t; 9), a 
portion of the image of moving object (21) contained in the original consecutive images must 
appear as the trace. ..the object trace on said cross-sectional image C(d, t; 9) at a certain time is 
determined. . . This is called trace cross-sectional image L(s, 9; t), and it is found that this image 
becomes a place containing the velocity vector of the moving object. . .this trace cross-sectional 
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image L(s, 9; t) is an image obtained by cutting said time-space image I(x, y; t) with a helix 
plane along the movement direction of the object", Fig. 5). However, Seki fails to teach a 
setting input unit and a setting value. Fels teaches that the input capabilities provided to the user 
have a corresponding input unit, therefore the provided input (sec. 1 1 st \ lines 1-3: "Using the 
mouse as a virtual trackball, the user is able to... translate... the video cube, or the cut plane." 
and sec. 3.3.1 lines 1-2: "The cut plane allows the user to move a planar window inside the video 
cube and examine the corresponding imagery. . .", in which the teachings of Seki thereby provide 
functionally equivalent setting of input to provide a value defining the cut surface, Fig. 4), 
therefore it would have been obvious to one of ordinary skill in the art to modify the captured 
frames generated by Seki with the interactive frame interaction provided by Fels because this 
modification would provide the ability to accurately display successive frames of animation or 
video collectively in a three-dimensional format in which the user may interactive with the data 
to define a plane by which to cut the surface of the data to define a representation of the change 
of the images or frames over a time interval thereby enabling temporal analysis of the data. 

Regarding claim 39, Seki describes that based on coordinates of characteristic points in 
the two-dimensional images, the image conversion unit, or image processor, cuts the box space 
by a curve defined by a function of the coordinates of the characteristics points (TJ0012 lines 1- 
1 1 : "This is called trace cross-sectional image L(s, 9; t), and it is found that this image becomes 
a place containing the velocity vector of the moving object. That is, this trace cross-sectional 
image L(s, 9; t) is an image obtained by cutting said time-space image I(x, y; t) with a helix 
plane along the movement direction of the object ", Fig. 5). However, Seki fails to teach a 
setting input unit and a setting value. Fels teaches that the input capabilities provided to the user 
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have a corresponding input unit, therefore the input (sec. 1 1 st H lines 1-3: "Using the mouse as a 
virtual trackball, the user is able to ...translate... the video cube, or the cut plane." and sec. 3.3.1 
lines 1-2: "The cut plane allows the user to move a planar window inside the video cube and 
examine the corresponding imagery...", in which the teachings ofSeki thereby provide 
functionally equivalent setting of input to provide a value defining a certain portion of the cut 
surface, Fig. 4), therefore it would have been obvious to one of ordinary skill in the art to modify 
the captured frames generated by Seki with the interactive frame interaction provided by Fels 
because this modification would provide the ability to accurately display successive frames of 
animation or video collectively in a three-dimensional format in which the user may interactive 
with the data to define a plane by which to cut the surface of the data to define a representation 
of the change of the images or frames over a time interval thereby enabling temporal analysis of 
the data. 

Claim 41 is rejected under 35 U.S.C. 103(a) as being unpatentable over Seki in view of 
Okajima (US 2002/0122037). 

Regarding claim 41, Seki teaches recording, in sequence, original moving pictures for 
each frame, determining, for each in-picture position of an image contained in a target frame 
(TJ0012 lines 1-2 and 8-11: "On said cross-sectional image C(d, t; 9), a portion of the image of 
moving object (21) contained in the original consecutive images must appear as the trace... this 
trace cross-sectional image L(s, 0; t) is an image obtained by cutting said time-space image I(x, 
y; t) with a helix plane along the movement direction of the object. This plane completely 
contains the information pertaining to the movement of the object. . .", wherein for the successive 
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frames, the position of an object in image is tracked, Fig. 4), a plurality of frames at 
predetermined time intervals from the frames recorded in said image memory (]|0013 lines 1-2: 
". . .all of the consecutive images within a prescribed time are obtained beforehand.''', where 
fames are captured over a predetermined time interval, therefore the time intervals between the 
frames is predetermined, Fig. 2), 

wherein said image conversion unit reads out, from the plurality of frames, data that 
correspond to the in-picture position and synthesizes the data in a ratio according to an attribute 
value (1(0012 lines 1-2 and 6-11: "...a portion of the image of moving object (21) contained in the 
original consecutive images must appear as the trace. . . This is called trace cross-sectional image 
L(s, 9; t), and it is found that this image becomes a place containing the velocity vector of the 
moving object. . . This plane completely contains the information pertaining to the movement of 
the object. . .", where a certain region from all the frames is captured, as shown in Fig. 4, where 
an attribute value, such as the proportional difference in the position of the object over time, is 
tracked and presented in a synthesized image that displays the movement of the object over a 
time interval, Fig. 5), and 

wherein said image data output unit sequentially outputs the synthesized and 
reconstructed image data along a time axis (T|0015 lines 1-5: "When there are plural moving 
objects in the cross-sectional images, plural groups of the cross-sectional images are prepared 
corresponding to the respective objects, to get the trace cross-sectional image for each object." 
and 1(0012 lines 1-2 and 8-11: "On said cross-sectional image C(d, t; 9), a portion of the image 
of moving object (21) contained in the original consecutive images must appear as. ..an image 
obtained by cutting said time-space image I(x, y; t) ...This plane completely contains the 
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information pertaining to the movement of the object. . ." and is illustrated in Fig. 3: axis T, in 
which output of several synthesized images is provided to enable a user to animate the movement 
of several objects in a sequence of images across the time axis T through generation of several 
synthesized images for each group that corresponds to an object in sequence of images, whereby 
a special effect may then be visualized showing the movement of several objects present in the 
sequence of images), however Seki fails to teach a computer readable medium encoded with a 
computer program. Okajima teaches a computer readable medium encoded with a computer 
program (1(0043 lines 4-5: ". . .program recorded in a storage medium../'). Therefore it would 
have been obvious to one of ordinary skill in the art at the time of invention to combine the 
image synthesis processing of Seki with the computer readable medium of Okajima because this 
modification enables execution of the synthesized images on a variety of computer systems 
through storage of the program or software utilized to implement the image synthesis on a 
memory that ensures portable and transferable execution of the stored computer software on a 
medium readable by a computer. 



Response to Arguments 

Applicant's arguments filed 1 1/13/08 have been fully considered but they are not 
persuasive. 

The applicant argues on pg. 12 2 nd line 2 - 3 rd T| line 8 of the remarks that Seki certainly 
does not teach forming new moving pictures by sequentially outputting at least the first and 
second frames formed in said synthesizing along a time axis, and fails to teach or suggest the 
output of moving pictures along a time axis. However, Seki teaches outputting at least a first 
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second frame formed in synthesizing (TfOO 1 2 lines 1 - 1 1 : "On said cross-sectional image ...a 
portion of the image of moving object (21) contained in the original consecutive images must 
appear as the trace. . .as shown in Figure 5. . .and a new image is formed. . .", where a sequential 
first, second or other subsequent images are combined and synthesized to form a new image L 
shown in Fig. 5, enabling the synthesis of any plurality of images, such as shown in Fig. 5, to 
successively generate more L images because the output of several synthesized images would 
enable a user to animate the movement of several objects in a sequence of images through 
generation of several synthesized images for each group of objects, each corresponding to an 
object in sequence of images, as described in ^[00 1 5 lines 1-5: "When there are plural moving 
objects in the cross-sectional images, plural groups of the cross-sectional images are prepared 
corresponding to the respective objects..."), in which moving pictures are output along a time 
axis (1J001 1 lines 4-1 1 : ". . .all of the images are obtained.. .in time sequence. ..the image 
appearing on the cut plane is taken as cross-sectional image C. . .plural cross-sectional images 
C(d, t; 0) can be obtained. . . ", in which several pictures are output along the axis T, as 
illustrated in Fig. 5, enabling several sequential frames to be output sequentially with respect to 
time causing generation of picture images that move along a time axis). 

The applicant argues on pg. 12 4 th ]| line 2 - 5 th ]] line 8 of the remarks that Seki does not 
discloses or suggests outputting moving pictures and therefore teaches away from forming new 
moving pictures by sequentially outputting at least the first and second frames formed in said 
synthesizing along a time axis. However, Seki teaches that a sequence of a first, second, and any 
subsequent plurality of pictures are output to form new pictures of movement (TjOOl 1 lines 4-11: 
". . .all of the images are obtained... in time sequence... plural cross-sectional images C(d, t; 9) 
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can be obtained. . . " and ](0016 lines 3-7: ". . .the movement trace of the object... completely 
contains the movement vector of the object, and. ..all of the information about the movement 
trace."'), in which the pictures are synthesized along a time axis (H00 12 lines 1-11: "...moving 
object. ..is called trace cross-sectional image L(s, 6; t)...this image... containing the velocity 
vector of the moving object. . .completely contains the information pertaining to the movement of 
the object. . .", where a synthesized image that displays the movement of the object as imaged in 
first, second, and subsequent consecutively captured images over a time interval, as shown in 
Fig. 3: axis T). 

The applicant argues on pg. 13 3 rd K lines 1 -3 of the remarks that the rejections of 
claims 37-39 should also be withdrawn for at least the same reasons provided in applicant's 
remarks due to their dependence on amended independent claim 22. However, Seki teaches the 
claimed limitations of claim 22, therefore the 35 U.S.C. rejection of claims 37-39 has been 
maintained. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to SAID BROOME whose telephone number is (571)272-2931. 
The examiner can normally be reached on M-F 8:30am-5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka Chauhan can be reached on (571)272-7782. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Said Broome/ 
Examiner, Art Unit 2628 



/XIAO M. WU/ 

Supervisory Patent Examiner, Art Unit 2628 



